Graph Barlow Twins: A self-supervised representation learning framework for graphs
نویسندگان
چکیده
The self-supervised learning (SSL) paradigm is an essential exploration area, which tries to eliminate the need for expensive data labeling. Despite great success of SSL methods in computer vision and natural language processing, most them employ contrastive objectives that require negative samples, are hard define. This becomes even more challenging case graphs a bottleneck achieving robust representations. To overcome such limitations, we propose framework graph representation — Graph Barlow Twins, utilizes cross-correlation-based loss function instead samples. Moreover, it does not rely on non-symmetric neural network architectures contrast state-of-the-art method BGRL. We show our achieves as competitive results best fully supervised ones while requiring fewer hyperparameters substantially shorter computation time (ca. 30 times faster than BGRL).
منابع مشابه
A Framework for Generalizing Graph-based Representation Learning Methods
Random walks are at the heart of many existing deep learning algorithms for graph data. However, such algorithms have many limitations that arise from the use of random walks, e.g., the features resulting from these methods are unable to transfer to new nodes and graphs as they are tied to node identity. In this work, we introduce the notion of attributed random walks which serves as a basis fo...
متن کاملGeneralized Optimization Framework for Graph-based Semi-supervised Learning
We develop a generalized optimization framework for graphbased semi-supervised learning. The framework gives as particular cases the Standard Laplacian, Normalized Laplacian and PageRank based methods. We have also provided new probabilistic interpretation based on random walks and characterized the limiting behaviour of the methods. The random walk based interpretation allows us to explain dif...
متن کاملGraph-based Semi-Supervised Learning Framework for Medical Image Retrieval
As low level features can not reflect the high level semantic in medical image search, in this paper, we propose an image retrieval algorithm to combine visual concept and local features by graph-based semi-supervised learning framework. More specific, we construct a graph model by distance between images, and add density similarity measure in the label propagation progress to get the membershi...
متن کاملSemi-supervised Data Representation via Affinity Graph Learning
We consider the general problem of utilizing both labeled and unlabeled data to improve data representation performance. A new semi-supervised learning framework is proposed by combing manifold regularization and data representation methods such as Non negative matrix factorization and sparse coding. We adopt unsupervised data representation methods as the learning machines because they do not ...
متن کاملA Self-Supervised Framework for Clustering Ensemble
Clustering ensemble refers to combine a number of base clusterings for a particular data set into a consensus clustering solution. In this paper, we propose a novel self-supervised learning framework for clustering ensemble. Specifically, we treat the base clusterings as pseudo class labels and learn classifiers for each of them. By adding priors to the parameters of these classifiers, we captu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Knowledge Based Systems
سال: 2022
ISSN: ['1872-7409', '0950-7051']
DOI: https://doi.org/10.1016/j.knosys.2022.109631